Using Jupyter for Reproducible Scientific Workflows

نویسندگان

چکیده

Literate computing has emerged as an important tool for computational studies and open science, with growing folklore of best practices. In this work, we report two case studies-one in magnetism another mathematics-where domain-specific software was exposed to the Jupyter environment. This enables high level control simulations computation, interactive exploration results, batch processing on HPC resources, reproducible workflow documentation notebooks. first study, Ubermag drives existing micromagnetics through a language embedded Python. second dedicated kernel interfaces GAP system discrete algebra its programming language. light these studies, discuss benefits approach, including progress toward more reusable research results outputs, notably use infrastructure such JupyterHub Binder.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Jupyter Notebooks - a publishing format for reproducible computational workflows

It is increasingly necessary for researchers in all fields to write computer code, and in order to reproduce research results, it is important that this code is published. We present Jupyter notebooks, a document format for publishing code, results and explanations in a form that is both readable and executable. We discuss various tools and use cases for notebook documents.

متن کامل

Provenance for Scientific Workflows Towards Reproducible Research

eScience has established itself as a key pillar in scientific discovery, continuing the evolution of the scientific discovery process from theoretical to empirical to computational science [13]. Extensive deployment of instruments and sensors that observe the physical and biological world are bringing in large and diverse data to the reach of scientists. Often, that data is more frequently shar...

متن کامل

Facilitating Reproducible Computing via Scientific Workflows -- an Integrated System Approach

Author: Cao, Yuan. MS Institution: Purdue University Degree Received: May 2017 Title: Facilitating Reproducible Computing via Scientific Workflows -An Integrated System Approach Major Professor: Yao Liang Reproducible computing and research are of great importance for scientific investigation in any discipline. This thesis presents a general approach to provenance in the context of workflows fo...

متن کامل

Scientific Workflows

In recent years workflows have emerged as a key technology that enables large-scale computations on distributed resources. Workflows enable scientists to design complex applications that are composed of individual application components or services. Often times these components and services are designed, developed, and tested collaboratively. Because of the size of the data and the complexity o...

متن کامل

Enhancing pre-defined workflows with ad hoc analytics using Galaxy, Docker and Jupyter

What does it take to convert a heap of sequencing data into a publishable result? First, common tools are employed to reduce primary data (sequencing reads) to a form suitable for further analyses (i.e., list of variable sites). The subsequent exploratory stage is much more ad hoc and requires development of custom scripts making it problematic for biomedical researchers. Here we describe a hyb...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computing in Science and Engineering

سال: 2021

ISSN: ['1558-366X', '1521-9615']

DOI: https://doi.org/10.1109/mcse.2021.3052101